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To express temporal properties of dense-time real-valued signals, the Signal Temporal Logic (STL) 
has been defined by Maler et al. The work presented a monitoring algorithm deciding the satisfiability 
of STL formulae on finite discrete samples of continuous signals. The logic has been used to express 
and analyse biological systems, but it is not expressive enough to sufficiently distinguish oscillatory 
properties important in biology. In this paper we define the extended logic STL* in which STL is 
augmented with a signal-value freezing operator allowing us to express (and distinguish) detailed 
properties of biological oscillations. The logic is supported by a monitoring algorithm prototyped in 
Matlab. The monitoring procedure of STL* is evaluated on a biologically -relevant case study. 



1 Introduction 



In this paper we deal with automatic decision of the question if a given continuous signal satisfies a given 
temporal property. This question originally arose in the domain of analogous circuits verification JTTIl . 
The procedure deciding this question has been called monitoring JTTIl . A monitor is constructed for 
a given property allowing off-line or even on-line decision over any continuous signal arising from a 
technical device (real case) or a numerical simulation procedure (model case) lfT8ll . An important fact 
is that the monitoring procedure is always time bounded and that validity of the given logic property 
(discrete nature) is decided only approximately on a signal (continuous nature). These restrictions are 
necessary but not limiting to significantly help in avoiding errors in systems construction ll2T1l . 

In systems biology, continuous signals most typically represent the model case - theoretical be- 
haviour of mathematical models mimicking the dynamics of biological processes. Temporal properties 
are employed to express biological hypothesis |4) and the monitoring procedure provides a 
promising analysis tool 0[22l[TT]|. Many dynamical phenomena that arise in biological systems have 
the form of oscillations. In physics the term oscillation represents an infinite behaviour periodically al- 
ternating certain quantities/qualities. The identifying aspect of oscillations is the fact that certain states 
in the phase space of the dynamical system are being repeatedly re- visited. A biological example of such 
phenomena are circadian rhythms. In lf23ll an interesting wet-lab experiment has been achieved on the 
cyanobacterium Cyanothece sp. that showed a relation between metabolic cycles and circadian rhythms. 
A mathematical model of oscillations in gene regulation of cyanobacteria has been provided in ll20l . 
Other models targeting oscillatory behaviour can be found e.g. in |[T5l[T4ll . 

In contrast to physics, the notion of oscillation in biology is usually understood informally and in 
a wider scope. Many wet-lab experiments show oscillatory behaviour with decreasing amplitude (so- 
called damped oscillation). Dual notion, oscillation with increasing amplitude, is also relevant: the 
question targeting how many oscillations and how strongly they increase until a permanent oscillation is 
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achieved comes to a significant interest when tuning biological processes via mathematical models |Q21 
fT4l . When considering the population behaviour as a real- valued signal in dense-time domain, we need 
to quantitatively express and compactly encode the mentioned types of oscillatory phenomena. 

In El, a linear- time logic with constraints over real values has been defined. It can be practically 
used to express many dynamical phenomena including oscillations of species concentration. The logic 
is interpreted over finite time-series of real-valued data obtained as discretely sampled solutions of dif- 
ferential equations (ODEs) (or a series of physical measurements). Formally, a technical problem may 
arise with the dense-time domain of considered signals. In general, in a particular interval on the time 
axis of the signal there may exist infinitely many points where a considered property (a predicate over 
real- values) changes its truth value. A rigorous semantics which treats this problem is given in ifTTIl in 
terms of continuous (real-valued) signals which are required to be piece-wise affine. In such a setting, 
it is assumed that there exists a finite interval covering of the signal time-domain where the end points 
can be sampled and on which the signal behaves "reasonably" in each individual time interval. The logic 
with such a semantics is called Signal Temporal Logic (STL) ifTTll and is based on the (bounded) Metric 
Interval Temporal Logic (MITL) J2). 

Neither STL, nor other temporal logic, as far as we know, provide any possibility to express (and 
distinguish) the classes of oscillations such as damped oscillations or oscillations with increasing am- 
plitude. The reason is impossibility of globally referencing (and relatively comparing) concrete signal 
values occurring in time points in which some local property is satisfied. Of course, in STL we can 
express directly any single concrete signal, but not a universal property without references to concrete 
values. E.g., the damped oscillation in Figure [Tc| can be expressed in STL as a sequence exactly reaching 
the 15 local extremes in the given order. In general, there can appear any number of local extremes in 
the observed time interval. Such a general property cannot be expressed in STL. 



- wvwwv 

(a)*(f) =sin(?§) (b)x(O = ^tth(^) (c)*(f) = fsin(?§) 

Figure 1: Various types of oscillations. 

In this paper, we propose an extension of STL, denoted STL*, based on enriching the logic with 
a signal-value freeze operator *[<p] which allows referencing to a signal value in a time point when <p 
is determined true. By means of atomic propositions enriched by variables of the form x* referring to 
"frozen" values, we can express damped oscillations by the following formula: 

G[o,60]((F[o,io]*[G[i 5 i ]X* >x + c])A(F [0; io]*[G [l5l0 ]X* <x-c])). 

It says that "there is always a time instant in near future which is a local maximum for some future 
interval and there is also another time instant in near future which is a local minimum for some future 
interval". In these intervals, another local maxima and minima for more distant intervals occur, and 
so on. This implies that the signal values can be surrounded by a decreasing function from top and an 
increasing function from bottom. The constant c sets the extent of damping. 
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The concept of freeze quantification has been introduced in to increase real-time temporal logic 
expressiveness by allowing every temporal operator to bind a time variable to the time it refers to. In 
the context of systems biology this concept has been used in Biological Oscillator Synchronisation Logic 
(BOSL) (6) to reason on oscillators synchronisation. In our work we shift the notion of temporal quantifi- 
cation to bind the real-valued signal variables to the temporal reference of time and we do it at the level 
of STL logic. Freezing of variable values has been used before in higher-level formalisms employing 
local variables H3l[l|. However, these formalisms do not support dense-time binding. 

It is necessary to note that when values of derivatives of signal values are known in all sampled 
points, some oscillatory properties can be expressed by using plain STL with predicates over derivatives. 
However, in such a case all needed derivatives (of all required orders) must be included within the signal. 
Getting these data can be computationally hard or even impossible. STL* allows to express (and monitor) 
oscillatory properties without the need of any additional information supporting the signals. 

The contribution of this paper is an extension of STL logic with signal value freeze quantification 
(Section [3]) motivated by the need to express oscillations appearing in biology. The paper is primar- 
ily focused on a practical aspect, we give an algorithm for monitoring STL* formulae over (bounded) 
continuous signals (Section]?]). The result is supported by a prototype implementation evaluated on a 
biological case study of E. coli repressilator (Section [5}. Please note that a detailed discussion of STL* 
expressiveness is provided in a master's thesis 1 10] that makes a preliminary version of this paper. 

2 Background 

First, we briefly recall the real- valued signals over continuous time from ifTTll . For the purposes of this 
paper, we focus only on signals over W 1 . 

Definition 2.1 Let T = [0, r], r e Q>o, T C R> , be a finite interval (time domain of the signal). A finite 
length signal s is a function s :T -^W 1 where \s\ = r denotes the length of the signal s. 

Definition 2.2 Given a signal s :T W 1 , n denotes the order of the signal s. We use si to denote the i-th 
component of the signal, Si : T — >► R (i.e., the canonical projection to the i-th element). 

A signal of order n represents one finite run of a continuous-time system with n variables. A variable 
can represent any quantity of the system, e.g., concentration of species, its derivative or any other attribute 
of the signal which can be measured and quantified. 

To translate the properties of a signal into terms of logic, we use a function transforming real values 
of the signal components in every time instant to the Boolean set {0, 1}, representing satisfaction or 
dissatisfaction of a property over the signal. These truth values are used as propositional variables in 
formulae of the logic. Unlike in fTTll . we restrict the allowed operations on signal variables to linear 
combinations and simple comparisons. Such a restriction is needed for our monitoring algorithm (Section 
[4]) and does not limit expression of the properties of our interest. 

Definition 2.3 Linear predicate V of order m is a function v : R m — » B of the form Y!i=\ a i x i ~ b where 
at,b E R are real coefficients, x\ are input variables, {<,<,>,>,=} and B is a Boolean set B — 
{0, 1}. The predicate v(jq,X2, . . .x m ) returns 1 iff the expression Y4L1 a^i ~ b is true and otherwise. 

However, in the logic defined in this paper, we need not only to work with the values of variables 
acquired in a single time instant, but also with a second set of values from another time instant. For this 
reason, we will define an additional function extracting truth values from the signal. 
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Definition 2.4 Atomic predicate fi is a function \i : 5^ n x Rq x Rq — )► B where y n is a class of signals 
of order n. For each signal s E 5? n andt^f E [0, \i is defined by the formula: 

H(s,t,t*) = v(ji(0, . . . , j n (f), Ji(f*), . . . ,*„(**)), 

where V w a linear predicate of order 2n and S( are components of the signal s. Values of the atomic 
predicate \ifort > \s\ or t* > \s\ are considered undefined. 

An atomic predicate over a signal s describes a Boolean property of the signal s, i.e., if a constraint 
specified by the linear predicate V is satisfied with respect to two time instants / and t*. An example 
of such a property is "under condition t* < t, the difference between values of variables s\ and S2 was 
higher in the time t* than in the time t ": 

H(s,t,t*) = v(si(t),s 2 (t),si(t*),s 2 (t*)) = si(t)-s 2 (t) < Sl (f)-s 2 (f), 

which can be rearranged to the standard form of a linear predicate according to Definition ( |2.3| ): 

v(ji (0,^(0^1 (n,s 2 (f))= Sl (t) -s 2 (t) - Sl ( t *)+s 2 (t*)<0. 

Instead of n(s,t,t*) = s\(t) - s 2 (t) < s\(t*) - s 2 (t*) we usually write n(s,t,t*) = x-y < x* —y*, 
denoting the variables of a signal s in time / by letters x,y,z, . . . and the same variables in time t* as 

x*,/,z*,.... 

As in 1 17], we will avoid the undesired cases of atomic predicates where the output values of the 
predicate are varying infinitely often. We assume that we deal with signals that are well-behaving with 
respect to every /I, that is, ji(s) has a bounded variability and every change in is detected in the 
sense that every point t such that /i(»s[f]) ^ lim t f- >t ji(s[t f ]) is included in the sampling JTTIl . 

3 A Logic for Oscillatory Dynamics 

In this section we describe the syntax and semantics of STL*. It is based on the Signal Temporal Logic 
(STL) |[T7ll which we extend with the signal-value freeze operator *[<p]. We consider atomic predicates 
restricted to linear as defined in the previous section. 

3.1 Syntax 

The formulae of the STL* are inductively defined by the following grammar: 

<p ::= Hi | ^(p | <pi V (f>z | (pi U [aM (p 2 | *p, 

where jii are atomic predicates from Definition |2.4[ -i and V are standard propositional logic oper- 
ators, U[ ai b] i s a bounded until operator constrained by the closed nonsingular time interval [a,b] with 
rational end-points. The interpretation of this operator is similar to the one used in the Metric Interval 
Temporal Logic (MITL) 0. Finally, * is the newly added unary signal-value freeze operator. In the 
standard way, we can derive additional temporal operators such as eventually (F^j <p = trueU^] <p) 
and globally (G [aM q> = ->F [fl ^ -.9). 
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3.2 Semantics 

Formulae of STL* are interpreted over triplets (s,t,t*) where s is a real-valued signal and t,t* E [0, \s\] 
are two time instants. We write (s,t,t*) \= <p, iff a formula <p is satisfied on the triplet (s,t,f). The 
satisfaction of an STL* formula is defined inductively to its structure: 



(s,t,t*) 




df 


H(s,t,t*) = 1; 




(s,t,t*) 




df 


(j,r,f*) ^<p; 




(s,t,t*) 


h 9i v<j(>2 


df 


(V.**) |= <pi or 


t*) h<P2; 


(s,t,t*) 


h 9l U [fl)A ] <jP2 


df 


3?' € [a + f,Z? + f] : (s 


/,'*) h<P2A 




df 


yt"£[t,t']:(s,t",t*) 




(s,t,t*) 


h*9 


(s,t,t) \=<p. 





(1) 



Because models for STL* are signals, we also speak about satisfaction of a formula over a signal. 

Definition 3.1 The satisfaction of a formula (p over a signal s is defined as: s \= (p 4=^4> (s,0,0) |= (p. 

The meaning of the operator *<p is to freeze the values of the signal over which the formula is 
interpreted in the current time point so we can use these values inside the subformula (p. Formula *<p is 
true in time / = to iff the formula (p is true with the time t* frozen in this time, i.e., t* = to. In combination 
with other temporal operators, interesting properties can be expressed such as "the value of the variable 
x is nondecreasing on the interval I" , (p\ = G/*[G[o 5 e] (x* < x)] , where £ > is an arbitrary constant. 
Or "at some point in the future (during interval I) the value x increases by the value of 5 within two time 
units", cp2 = F/*[F[ 0j 2] (** + 5 =jc)]. 

To determine the satisfaction of a formula over a signal, the signal has to be of a sufficient length. 
The necessary length can be computed for each formula inductively to its structure as in JTTIl . The freeze 
operator does not require any additional length: 

m = 0; 

Z(-.p) = l(q>); 

l((piVq>2) = max(/((j0i),/((j02)); (2) 

KViUiaM^) = max(/((pi),/((j02)) + &; 

K*<p) = / ( ( p)- 



From Definition |3.1 1 we can see that if a formula <p contains an atomic predicate fit and there is no 
operator * wrapping this predicate then all variables concerning the frozen time instant t* are handled as 
if/* = 0. 

From the definition of the semantics of STL* ([T]) follows that in a formula with several nested oper- 
ators *, the meaning of a frozen variable x* is local. I.e., it relates to the nearest operator *, because the 
content of the variable t* is overwritten by the most nested freeze operator *. It implies that only a single 
set of frozen signal values is accessible at every place in the formula. For example, in a formula: 

* [x* < y U 7 (x* = y A * [ G [0>5 ] **>?])], (3) 



the first and the second occurrence of the variable x* relate to the first usage of * and address the time 
t = 0, in which the formula is interpreted. The third occurrence of x* 9 in contrast to the previous two, 
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relates to the second operator * and addresses the time instant in which the subformula on the right side of 
U/ becomes true. Semantics restricted in this way does not excessively limit the capability of expressing 
various biological behaviour while remaining computationally feasible. 



4 Algorithm 

In this section we deal with monitoring of an STL* formula, which means to determine the satisfaction 
of a formula over a finite length signal. The monitoring procedure introduced in this paper is inspired by 
constrained LTL model-checking 10 and monitoring of STL formulae ifTTll . but needed to be extended 
into 2D space due to freeze operator *. It is because the task is solved simultaneously for two time 
instants, actual time and frozen time. 

The idea of the monitoring procedure is to construct a parse tree of the formula and check the satis- 
faction in a bottom-up manner. First step in checking a formula <p over a signal s is to construct a set of 
time points in which the formula <p is satisfied. 



Definition 4.1 Let (p be a STL* formula and s be a real-valued signal. A set Sy iS — {(t,t*) E [0, l^] x 
[0, \s\] | (s, t*) \= <p} is called the satisfaction set of formula (p over signal s. We use short-form notation 
Sep whenever the signal s is obvious from the context. 

Now we inductively construct satisfaction sets for nodes on higher levels of the parse tree. The last 
step of the procedure is to decide if s \= (p from satisfaction set for the formula (p. According to Definition 



3.1 it is equivalent to checking whether the satisfaction set contains the point (0,0). 

Constructing the satisfaction set for a general signal can be a very difficult task. For this reason we 
will consider the monitoring algorithm only for piecewise linear signals. This is a reasonable requirement 
because in most cases we deal with time series produced by numerical simulations of modelled systems 
or by some measurements. These series can be interpreted as piecewise linear signals considering the 
values changing linearly between two adjacent points. If required, other points can be generated in 
between the existing points to make the signal more precise. 



Definition 4.2 A real-valued signal s of order n is called piecewise linear signal iff all the projections 
Si(t) : [0, \s\] — >> M,i = 1, . . . ,n are piecewise linear functions defined on a finite set of intervals J? — 
{I u I 2 ,...J m } where IjC [0,\s\\J = I, . . . ,m andft f / = [0,\ S \\ 

Theorem 4.1 (Inductive construction of the satisfaction set) Let s be a piecewise linear signal and 
(p a formula in STL*. The satisfaction set Sy of the formula (p over the signal s can be constructed 
inductively with respect to the structure of the formula (p: 

= {(M*)eR+xM+|M(M,'*) = i}; 

S^cp = Rq" x Kq~ \ S(p\ 

S(p x \j(p2 — Sy x UiS^; 

fy,u [aii fc = {(*,'*) eS.p, | 3t'e [t + a,t + b] : (t',t*) eS^A 

Vt"€[t,t']:(t",t*)€S (pi }; 
S* v = {(t,f)6i;xR + |(r,r)6S f ,f6R + }. 

Proof Each of the equations follows directly from the definition of semantics of STL* dTb. 
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The assumption of piecewise linear signals in combination with linearity of atomic predicates (Def- 



initions |2.3[ |2.4| ) enables us to construct satisfaction sets for atomic predicates in polynomial time and 
to easily compute sets belonging to higher formulae. The formalism we use for the representation of 
satisfaction sets are convex polytopes. 

Definition 4.3 Convex polytope P C W 1 is a set {x = (jq,x 2 , • • • ,*») € R nxl \ Ax < b} where A E M mx ^ 
is a matrix and b E M mxl is a column. A convex polytope in R 1 is called a line segment, in M? a convex 
polygon. 



Each inequality T!j=i a ij x j < b{ in Definition 
obtained as intersection of these subspaces. 



4.3 



identifies a subspace of W 1 . The convex polytope is 



Theorem 4.2 Assume s a piecewise linear signal and J? — {/i, . . . ,/ m } the set of intervals on which 
s is defined. Let ji be an atomic predicate over the signal s. The predicate n(s,t,t*) — YJl=\ a i s iif) + 
Y!i=\ bi$i(t*) 2^ b, ^G {<,<,>,>,=} is a linear function over the signal s in variables t andf according 



to Definition 



2.4 



Denote Sf: = {(t,t*) E h xlj \ fi(s,t,t*) 



1} where /, j E {1, . . .m},/;,// E ^ ^ 
of time instants at which the atomic predicate ji is satisfied over signal s on rectangular area l[ x Ij and 

S^j = (7) xlj)\ S^j its complement. For t E Ii,t* E 7, /7zere can arrive two situations: 

1. ifnu = = f then the set Sfj makes a line segment (possibly degenerated to a single point or an empty 
set); 

2. if ~^=, then the space l[ x Ij is divided by the line Yli=\ a iSi{t) + YJi=\biSi(t*) — b into two 
subspaces S^~j and S^j (Figure^. (Again, there might be a degenerated case when the line 
YIi=\ a i$i{t) + Y!i=\ biSi{t*) — b does not cross the rectangle {(t,t*) E I\ x Ij}. In this case S^j = 
and Sjj — Ii x Ij or vice versa). 



Proof Described properties result from the linear form of atomic predicates \2.4\ and from the fact that 
signal s behaves linearly on each interval Ii E J? , i E { 1 , . . . m}. 




Figure 2: An illustration of the set for a formula x* < §*+y on the subspace ^ x ^ = [0,4] x [10,13]. 

In both cases, the set Sfj makes a convex set easily describable by set operations over convex poly- 
topes. In the first case, a line segment itself is a convex polytope. In the second case, either the set is 
a convex polytope, or (when ^E {<,>}) it is a convex polytope after subtraction of one bordering line 
segment, which is a polytope. 

Using this algorithm we can express the satisfaction set as = Uije{i,...,m} where are the 
sets described above constructed by set operations on polytopes. The set can be further simplified by 
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joining adjacent polytopes. Having satisfaction sets for atomic predicates, we could inductively construct 



satisfaction sets for composite formulae from Theorem|4[T]again as operations on polytopes, which could 
be achieved in polynomial time (H. 



However, working with precise satisfaction sets as defined in Theorem |4.1| can be quite a difficult 
task. We have to work with polytopes of different dimensions (polygons, lines and points) and operations 
over sets of these objects can be unnecessarily demanding. In real-world applications, we could end up 
performing an expensive monitoring over noisy signals measured on imperfect devices or computed 
on computers with finite numerical precision. Hence think about less precise, yet faster monitoring 
algorithm. 

We can imagine a noisy signal as a signal measured or computed with finite precision. The actual 
values of the variables can differ from the values presented by the signal up to some error £ > 0. This 
inaccuracy in the domain of values implies also inaccuracy in the time domain. When investigating the 
time instant in which some event occurred (e.g., x > 0) we cannot be sure when exactly it happened. That 
is because the critical value x = is burdened by an error and it is possible that x = 0, but also that x > 
or x < in that particular time instant. 



Imagine we are in the situation from Theorem 4.2 but working with a noisy signal. We cannot be 



sure about the border of the set Sfj due to the error £. The condition YIi=\ a i s i(t) +E?=i^(/*) = ^ 
defining points on the border of Sfj could be easily broken by changing the values of the signal s by 
arbitrary small values from (0, e). For this reason, we will ignore these border points and count them as 
they were in or i n Sjj depending on what would be computationally easier. As a consequence, in the 



first case in Theorem 



4.2 



, Sfj = 0, and in the second case, it does not matter if ~ = < or ~ = <. 
As a result of this simplification, the set of allowed operators in atomic predicates is restricted to 
{<,>}. The remaining three operators lost their sense. With signals burden with some error £ > 
the satisfaction of atomic predicates can be meaningfully determined only for time instants inside the 
satisfaction set. Hence the satisfaction of a formula using the operator =, e.g., x = Z?orx = ;y + 2, cannot 
be determined. Every reference to a precise value has to be replaced by a sufficiently large interval, e.g., 
formula x = b can be replaced by x > (b — 8) Ax < {b + 8) for some 8 > e/2. 

Based on these assumptions, monitoring can be solved approximately. For every pair of intervals 
IiJj E J? , the satisfaction set on this area can be described by a single convex polygon Sfj. For the 
whole satisfaction set S^ s we get S^ s = \Jije{i,...,m}^tj- The problem of construction of satisfaction 



sets for composite formulae from Theorem 4. 1 is reduced to operations with sets of convex polytopes in 



plane for which efficient algorithms exist (51 . 

Algorithm 4.1 (Approximative monitoring algorithm for piece wise linear signals) 

Input: A piecewise linear signal s and an STL* formula <p. 
Output: Answer to the question s \= (p. 

Algorithm inductively constructs the satisfaction set S^: 

All the computations are performed on parts of the signal s of sufficient length. This can be computed 
according to Q. If the signal does not have the sufficient length, the answer returned by the algorithm 
might be wrong. 

1. 5 M = \Jije{i,...,m}^U' ^ e com P uta ti° n °f the satisfaction sets 5^ for individual intervals is per- 
formed according to Theorem [42l but without determining the satisfaction of the borders (as was 
justified in this section). 
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2. = x ^f)\S(p. The result can be computed as a simple Boolean operation on polygons. 
It is necessary to ensure that the resulting set consists only of convex polygons, which could be 
achieved for example by triangulation (SJ. 

3. S<p lV (p2 = S(pi U^^. Again a Boolean polygonal operation. 

4. S*q> = {(t,t*) G Mq x R+ | (f ,f) E 5(p,f* E }• The satisfaction set for the freeze operation can be 
computed by: (1) finding an intersection between the line f = t and the satisfaction set Sy (black 
line segments in Figure [3a]), (2) substituting values in the second component by the whole axis 
t*, i.e., making a projection to the first component / and then a Cartesian product with the axis t* 
(Figure [3b]). 




(a) 



t 

(b) 



Figure 3: Example of computing satisfaction set for the formula *<p. a) The satisfaction set represented 
as a set of (overlapping) convex polygons (different colors are used only for depicting the fact that the 
set consists of convex polygons) and the line t = t*. The regions of intersection of the line and the 
satisfaction set are depicted in black color, b) Resulting set obtained by projecting the intervals of 
intersection to the axis / and making a Cartesian product with the axis f . 

5 - 5 <PiUm<P2 = {(*,**) E | 3t f e[t + a,t + b}: (f',f*) E AVf" E [tj] : (t n \t*) E S^}. To be more 
illustrative, we explain this part of the algorithm from the geometrical point of view, identifying 
values / with the horizontal axis and values t* with the vertical axis. 
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Fi gure 4: First step of computation of S^u^^ * s to ^ n( ^ the intersection D 5^. 



For each convex polygon P E fl 5^ (Figure 4c ) the following procedure is performed: 
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(a) P U S(p x (b) ordered vertices (c) rectangular polygons (stripes) 

Ri,i= l,...,n- 1 



Figure 5: Next, the space is divided into horizontal stripes. The task is solved in each stripe separately. 



5a 



(a) Vertices of polygons {P} U are increasingly ordered by the second component t* (dupli 

cates can be removed). Denote the ordered set V = (V\ , V2, • • • V n ) (Figures 

(b) For i = 1, . . . ,w — 1 every neighbouring pair of vertices V* = V/+i 
specifies a rectangular polygon (stripe): 

df 



5b]); 



(Figure [5c]). in a form of line segment is considered empty because we do not care about 
the border points. 



df 



(c) The task is solved in every stripe Rf separately. For every nonempty Ri denote Pi = HP and 



df 



Si = Ri fl S(p r . Due to the way of construction of Ri, all polygons in Si and the single polygon 
Pi have all their vertices on the upper (t* = tf +1 ) or the lower (t* = t*) border of the stripe 
In fact, these polygons can take only the shape of a triangle or a trapezoid 



Ri (Figure pd\ 
(Figure [7]). 



5- 2 
1.5 
1 

0.5 








R 4 




'4 



2 3 j 4 5 6 

(a) the stripe i?4 




(b) points on the left side of the line ul ( c ) A 4 = the rightmost polygon in S' A 



Figure 6: The potential polygons are identified. (The solution cannot be placed further in time than the 
property (fa. Moreover, the property q>\ must continuously hold at all time points until q>2 is satisfied.) 

Now we get rid of the polygons lying on the right side of Pi because their points cannot be 
in the solution (they represent the time past the event 92). To do so, we isolate the upper 
and lower rightmost vertices of the polygon P t . Denote them as u = (u tl u t *) and I = (l t Jt*) 
(Figure [6b]). We get a new area: 

/?| = {(f,f*) eRi I lies on the left side of the line ~ul}. 
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The solution can lie only in this area, so we can restrict Si to 5- = R f t fl S;. 




°0 1 2 3 4 5 6 7 8 

t 

Figure 7: An example of a stripe and all possible shapes of polygons inside a stripe. 



(d) All the adjoining polygons (sharing an edge) in 5- are connected to form maximal seamless 
convex polygons (e.g., the green and orange polygons in Figure [6b]). 

(e) Let Ai be the rightmost polygon in S[ (Figure 6c) (Even after connecting some polygons in 5- 
their shape can still be only triangular or trapezoidal (Figure [7]) so there is only one rightmost 
polygon in S-). Then A- = A t fl (Pi © (b, a)) is the solution for the stripe Ri (Figure [8]). 

The operation © is defined as A © (a, b) = {(x,y) E M x R | 3c E (fl, fe) : (x+c,y) E A} which 
is equal to A © (—a, — fe), where © is the Minkowski sum. 

(f) The final satisfaction set is given by 5^ u [ab] ^ = [TiZi^'v 




(a) P 4 before application of the operator (b) the shifted polygon P 4 (2.5,2.5) (c) A' A = A 4 n (P4 (2.5, 2.5)), the final 

solution in the stripe R f 4 



Figure 8: Last step is to consider the interval [a,b] bounding the operator U. 



6. The result s \= <p which is equivalent to (0, 0) E 5^ is returned. 

Remark 4.1 The satisfaction set for temporal operator future <p = trueU^j <p f and hence G^j (p J 
can Z?e computed more easily than according to the step^ It can be obtained directly as S^ [ab]( p — 
SyQ^^a). 



4.1 Time and space complexity 

Time and space complexity of all steps of the Algorithm |4.1| is proportional to the number of polygons 
they are working with. Number of polygons generated in step 1 is at most n 2 for each atomic predicate, 
where n is the number of intervals on which the signal is defined. 

The number of polygons does not asymptotically change during the computation of operations de- 
scribed in other steps of the algorithm and all these functions do not work slower than 0(n 2 ) (see [HI for 
more details). The output polygons also keep small number of vertices during the process. 

The upper bound on the total computation time is therefore 0(kn 4 ), where n is the number of intervals 
on which the signal is defined and k is the size of the investigated formula. 
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5 Evaluation and Case Study 



A prototype of the approximative monitoring Algorithm 4. 1 was implemented in Matlab (version R201 lb). 
The Multi-Parametric Toolbox (MPT) package JT6l (version 2.6.3) was used for the polygonal opera- 
tions. We have not focused on efficiency of the implemented algorithm, our goal was to prove the con- 
cept of the presented algorithm. Detailed description of the implementation, results of the experiments 
and performance analysis can be found in ifTUl . 

We have studied a biological system of three transcriptional repressors which was designed and built 
into bacteria Escherichia coli lfT4l . Concentrations of involved proteins are periodically oscillating which 
causes periodic production of a green fluorescent protein. Intensity of fluorescence of this protein, which 
can be measured, gives evidence of the ongoing activity of the network (Figure [9]). 
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Figure 9: The fluorescent intensity of a colony of Escherichia coli containing the repressilator. The 
intensity is increasing overall due to the increasing number of individuals in the colony. The period of 
oscillations is lower than the time between cell division, but the whole repressilator is transmitted from 
generation to generation. Figure was taken from |[T4ll . 

The network was modelled as a system of six differential equations: 



ni] 

m 



-m\ - 
-m 2 - 
-m 3 - 



a 
a 

a 

\+ P n 2 



Oo; pi = -j3(pi-mi); 
Oo; p 2 = -P(p2-m 2 y, 
Oq; p 3 = -p(p3-m 3 ). 



(4) 



Where rhi = -^-^pi = -^-\m\^m 2 and m 3 correspond to activity of genes lacl,tetR and cl\ pi,p2 
at at 

and ps are concentrations of corresponding proteins and a, j8 , Ofo, n are constants (a typical behaviour of 
the system is depicted in Figure [T0|). 

The analysis of the system Q and the estimation of parameters a, j8, Oo,n producing the oscillatory 
behaviour was originally done by means of manual qualitative analysis of ODEs fT4ll . However, we can 
perform the analysis automatically using the monitoring of STL* formulae. We can specify the desired 
oscillatory property by the formula: 

<P = G[io,i90] F [o,50] *[(F[i,50] < < m) A F [1;50 ] m* > mi)] (5) 

and test the satisfaction for different values of parameters on runs of the length at least 300 minutes. The 
expected period has to be lower than 50 minutes. We start the testing 10 minutes later after the beginning 
to avoid the initial swing and end the testing 50 minutes before the end of the measurement because the 
signal might be cut in the middle of a period. 
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Figure 10: A typical signal produced by the system Q. Only variables m\,m2 and m?> are depicted. 




200 250 



(a) a = 400, /3 = 0.2, Oq = 0.2, n = 2 



(b) a = 400, P = 0.2, Oq = 2, n = 2 



Figure 11: Sample runs of the system ^ for different sets of parameters. The initial values were m\ 
0.1, /W2 = 0.3, m3 0.2, pi 0.2,^2 = 0.1, 773 = 0.3. Only the values of m \ are depicted. 



Formula ([5]) is satisfied by both runs in Figure [TT] To avoid the case of damped oscillations, we can 
add the formula: 

V = G[io,200]*[(F[i,50]< <m)]. (6) 

It ensures that the values reached in each period are not decreasing. By connecting formulae ([5]) and 
Q we get the formula (pAij/. It does express the desired oscillatory behaviour in Figure [TTa| and it is not 
satisfied by signals of the type depicted in Figure [Tib] 

Another property of the repressilator can be expressed by the formula: 



G[o,270] *[( F [o,30] Oi + 1 > m Ami - 1 < m 3 )] . 



(7) 



which means that "the values ofm\ precede the values ofm^ in such sense that for every value ofm\, m?> 
reaches similar value in short time after m \ did" (Figure [T2|). 

Full estimation of parameters could not be performed due to high time demands of the implemented 
monitoring algorithm [10]. A single run of the monitoring algorithm for the formulae ([5]), ^ or ([7]) 
over a signal sampled by 80 points took several hours on a regular PC. Reduction of the number of 
points describing the signal would lead to excessive loss of information. We have found out that the 
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Figure 12: Sample run of the system Q satisfying the formula ([7]). The parameters were a = 400, /3 = 
0.2, Oo 0.2, ft 2 and the initial values m\ = 0. X.mi = 0.3, m3 0.2, pi 0.2, /?2 = 0. 1 .pi = 0.3. 
Depicted variables are m\ - red and - green. 

bottleneck in efficiency of the prototype implementation lies in polyhedral operations performed by 
MPT. Since we work in 2D and need only a small subset of operations, we believe that our algorithm 
can be significantly accelerated when an optimal implementation is employed. Here we focused on 
demonstrating the applicability while leaving efficiency for future work. 

Different task would be to ensure that the behaviour of concentrations of the fluorescent protein in the 
bacteria (Figure [9]) is in correspondence with the model. While it could be done only manually in llT4lL if 
we had the data, we would be able to test the properties of the measurements identically as the properties 
of the signals produced by ODEs. 



6 Conclusion 

We have proposed an extended Signal Temporal Logic STL* motivated by the need to express properties 
of biological dynamical systems in a detail sufficient to distinguish different shapes of oscillation. We 
have provided a monitoring algorithm that approximately computes the truth value of an STL* formula 
for a given continuous (piece-wise linear) signal. The method has been prototyped in Matlab and the 
results achieved on a case study of oscillatory behaviour of the repressilator showed that the method 
satisfactorily works for signals generated by numerical simulation. However, the employed library MPT 
for polyhedral operations appears to be not efficient enough to satisfy the needs of practical usage. 

For future work on the practical side, we plan to implement more efficient algorithms for the specific 
polyhedral operations we use in the monitoring procedure. Another straightforward direction of future 
development is lifting of the robustness measure ifTTTl to the extended logic. 

A very inspiring work is lfT2l where Time-Frequency Logic (TFL) is defined by shifting STL seman- 
tics to frequency domain. TFL provides another way to express permanent oscillations. However, non- 
pure oscillatory behaviour such as damped oscillations require specific elaboration in the time-domain. 
Joining TFL semantics with the STL* concept of real- value freezing can be an interesting step further. 
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